Distribution system for digital image content and reproducing method and medium recording its reproduction program

ABSTRACT

A distribution system for digital image content, a method of reproducing digital image content, and a medium recording a program for reproducing digital image content are disclosed. The system comprise: a first distribution means ( 21 ) for distributing digital image data ( 11 ); a second distribution means ( 22 ) for distributing secondary data ( 12 ); a first reproduction means ( 24 ) for reproducing the digital image data ( 11 ); a second reproduction means ( 25 ) for reproducing the secondary data ( 12 ); and an output means ( 26 ) for superimposing the two reproduced data. The secondary data ( 12 ) is prepared using a markup language such that a reproduction start point and a reproduction end point correspond to an image frame-specific code for specifying an image of the digital image data ( 11 ) and that the secondary data ( 12 ) distributable from a different server having a different IP address is reproduced synchronously with the reproduction of the digital image data ( 11 ).

TECHNICAL FIELD

The present invention relates to a technique for distributing andreproducing digital image content consisting of digital image data andsecondary data corresponding to the digital image data, and moreparticularly to its distribution system, reproducing method and mediumrecording its reproduction program.

BACKGROUND ART

In recent years, digitalization of image content such as movies orbroadcast programs has been proceeding rapidly. As a result, digitalizedimage content has been distributed to an audience through digitalbroadcasting or Internet distribution. In this instance, as imagecontent to be broadcasted or distributed, content in which image dateand secondary data are previously and integrally included has been used.With reference to FIG. 1, a conventional distribution method for digitalimage content will be described. FIG. 1 is an explanatory viewillustrating the procedure for preparing, distributing, and reproducingconventional digital content.

As shown in FIG. 1, image data 1 and secondary data 2 such as subtitlesare superimposed together to prepare one image master 3. The secondarydata 2 incorporated in this image master 3 is treated as image data.Next, the image master 3 is digitalized to prepare a digital master 4.This digital master 4 is a master file for the image content that isdistributed through Internet and the like. The image contentaccommodated in the digital master 4 is reproduced at the receiver side,and is viewed as the digital image content 5.

When the conventional image content is distributed through Internet andthe like, digital code is compressed and distributed at the transmitterside, and the compressed digital code is decrypted and reproduced at thereceiver side. If the throughput capacity of the receiver side isrelatively low, a problem arises in that missing frames and flickeringof the subtitles occur at the same time.

Further, when a correction is necessary during the edit until thedigital master 4 is prepared, the correcting operation causes a lot ofdifficulties. For example, if the secondary data requires a correction,the secondary data is firstly corrected, and subsequently, the imagemaster 3 and the digital master 4 are prepared again.

Furthermore, subtitles or advertisements are often superimposed while adigital broadcasting program is on the air. This can be done bysynthesizing the subtitles onto the image date at predetermined timingsor by switching the image data to the advertisement data. In thisinstance, the subtitles or the airplay schedules of the advertisementsare written on a program schedule table, which is so-called a “cuesheet”, and the predetermined subtitles or advertisements arebroadcasted on schedule of the air time.

When sound of a foreign film is translated to prepare subtitles,subtitles are prepared for each translating word, and the edit iscarried out by the same operation as above. In the aforementionedprocedure of the edit, a great effort is required for each translatingword, which indirectly discourages a production of multi-kinds ofsubtitles. Accordingly, in the conventional distribution method fordigital image content, there is a drawback in that the operations fromedit to distribution require a great effort and a lot of difficulties.

DISCLOSURE OF INVENTION

In order to eliminate the above drawbacks, the present invention seeksto provide a distribution system for digital image content, areproducing method of digital image content, and a medium recording areproduction program, wherein image data and secondary data areseparately distributed and reproduced synchronously at the receiver sidesuch that operations from edit to distribution are carried outeffectively without loss.

In order to achieve the above object, the following inventions aredescribed in accordance with the principle of the present invention.Herein, the term “secondary data” in the present invention indicatesdata such as subtitles, dubbing, and sign language. And data consistingof character information, graphics information, image information, orsound information can be treated.

According to the invention, a digital image content distribution systemcomprises a first distribution means for distributing digital imagedata, a second distribution means for distributing secondary dataprepared in accordance with the digital image data, a first reproductionmeans for reproducing the distributed digital image data, a secondreproduction means for reproducing the secondary data, and an outputmeans for superimposing and outputting the reproduced digital image dataand the reproduced secondary data.

The secondary data is prepared with the use of a markup language suchthat a reproduction start point and a reproduction end point correspondto an image frame-specific code for specifying an image frame of thedigital image data, and the secondary data is reproduced synchronouslywith the digital image data in a manner such that the secondreproduction means leads out the reproduction start point and thereproduction end point of the secondary data corresponding to the imageframe to be reproduced during the reproduction of the digital imagedata.

In this distribution system, digital image data and secondary data areprepared and distributed separately. Since secondary data such assubtitles is considerably small in size when compared with digital imagedata, even if the throughput capacity of the receiver side is relativelylow, flickering of the subtitles arisen in the prior art distributionsystem will be eliminated.

A reproduction start point and a reproduction end point are allocated tothe secondary data so as to correspond to an image frame-specific codecontained in the digital image data. When the image data is reproducedat the receiver side, the reproduction start point and the reproductionend point of the secondary data are led out so that the secondary datais reproduced synchronously with the image data.

In this distribution system, unlike the prior art system, thepreparation of the image master by superimposing subtitles onto theimage data and the preparation of the digital master become unnecessary.Further, even if a correction is required for the secondary data, it ispossible to correct the secondary data without a correction of thedigital image data. This facilitates a correction of the secondary dataand contributes to improve the quality.

Further, since the secondary data is prepared with the use of a markuplanguage, as the secondary data, multimedia such as character, sound,and image can be treated. In other words, dubbing or sign language canbe treated in addition to subtitles. The secondary data may be preparedby variety of translating languages so that users can select a desiredlanguage. The size and the color of the character may vary.

According to the invention, a digital image content distribution systemcomprises a server distributing digital image data and secondary datacorresponding to the digital image data, and a user terminal reproducingthe distributed digital image data and the distributed secondary data,the server and the user terminal being connected each other throughInternet, so that the digital image content is distributed from theserver to the user terminal.

The server includes an image data file for storing the digital imagedata, a secondary data file for storing the secondary data, adistribution information file for storing distribution informationrelating to the digital image data and the secondary data, adistribution means for distributing the digital image data and thesecondary data in accordance with a requirement from the user terminal,and an information supply means for supplying the user terminal with thedistribution information.

The secondary data is prepared with the use of a markup language suchthat a reproduction start point and a reproduction end point correspondto an image frame-specific code for specifying an image frame of thedigital image data, and when the digital image data and the secondarydata are distributed in accordance with a requirement from the userterminal, the secondary data is reproduced synchronously with thedigital image data in a manner such that the reproduction start pointand the reproduction end point of the secondary data corresponding tothe image frame to be reproduced are led out during the reproduction ofthe digital image data.

In this distribution system, the digital image data and the secondarydata are distributed through Internet. The digital image data and thesecondary data are stored in the server. When the user requires adistribution, the digital image data is reproduced at the receiver side,and the secondary data is reproduced synchronously with the digitalimage data. For example, if variety of secondary data consisting ofdubbing or sign language is stored in the server, the user can selectdesired secondary data according to his/her favor or purpose.

According to the invention, a digital image content distribution systemcomprises a first server distributing digital image data, a secondserver distributing secondary data corresponding to the digital imagedata, and a user terminal reproducing the distributed digital image dataand the distributed secondary data, the first server, the second server,and the user terminal being connected each other through Internet, sothat the digital image content is distributed from the server to theuser terminal.

The first server includes an image data file for storing the digitalimage data, an image data distribution information file for storingdistribution information relating to the digital image data, adistribution means for distributing the digital image data in accordancewith a requirement from the user terminal, and an information supplymeans for supplying the user terminal with the distribution informationrelating to the digital image data. The second server includes asecondary data file for storing the secondary data, a secondary datadistribution information file for storing distribution informationrelating to the secondary data, a distribution means for distributingthe secondary data in accordance with a requirement from the userterminal, and an information supply means for supplying the userterminal with the distribution information relating to the secondarydata.

The secondary data is prepared with the use of a markup language suchthat a reproduction start point and a reproduction end point correspondto an image frame-specific code for specifying an image frame of thedigital image data, and when the digital image data and the secondarydata are distributed in accordance with a requirement from the userterminal, the secondary data is reproduced synchronously with thedigital image data in a manner such that the reproduction start pointand the reproduction end point of the secondary data corresponding tothe image frame to be reproduced are led out during the reproduction ofthe digital image data.

In this distribution system, the digital image data and the secondarydata are distributed from different servers through Internet. Thedigital image data and the secondary data a restored in differentservers. When the user requires a distribution to each server, thedigital image data and the secondary data are distributed from therespective servers. The digital image content is prepared by reproducingthe secondary data synchronously with the digital image data reproducedat the receiver side. In other words, the secondary data can bedistributed from a different server having a different IP address. Sincethe secondary data is administered independently, it is possible to geta sponsor for the secondary data itself, enhancing the commercial valueof the secondary data alone. Furthermore, the server only fordistributing the secondary data may be a server with low data processingcapacity.

According to the invention, in the above digital image contentdistribution system using Internet, the secondary data is prepared by aplurality of translating languages, and advertisements corresponding toa distributed translating language may be automatically distributed.

In this distribution system, for example, advertisements of Koreancompanies with Korean language are distributed when the secondary datawith Korean subtitles is selected, and advertisements of Chinesecompanies with Chinese language are distributed when the secondary datawith Chinese subtitles is selected. This enables to distributeappropriate advertisements corresponding to respective translatinglanguages of the secondary data. Therefore, by distributing thesecondary data accompanied with advertisements with a correspondingtranslating language, the user naturally watches and understands theadvertisements without awareness.

According to the invention, a method of reproducing digital imagecontent comprises the steps of: preparing secondary data with the use ofa markup language such that a reproduction start point and areproduction end point correspond to an image frame-specific code forspecifying an image frame of digital image data; and reproducing thesecondary data synchronously with the digital image data by leading outthe reproduction start point and the reproduction end point of thesecondary data corresponding to the image frame to be reproduced duringthe reproduction of the digital image data.

In this reproduction method, the secondary data can be reproducedsynchronously with the digital image data, even if the secondary data ischaracter information, sound information, or graphics information.Further, since the reproduction of the secondary data is not dependenton the coding method of the digital image data, a common hardware can beused for both reproducing the digital image data and reproducing thesecondary data. Therefore, if software for reproduction is installed inthe existing personal computer, the digital image data and the secondarydata can be readily reproduced.

According to the invention, a method of reproducing digital imagecontent comprising the steps of: inputting designation signalsindicating a reproduction start point and a reproduction end point intoa secondary data preparation means, and with the use of a markuplanguage, preparing secondary data in which the reproduction start pointand the reproduction end point are designated so as to correspond to animage frame-specific code for specifying an image frame of digital imagedata; distributing from a distribution means to a user terminal thedigital image data without processing; and reproducing the secondarydata at the user terminal synchronously with the digital image data byleading out the reproduction start point and the reproduction end pointof the secondary data corresponding to the image frame to be reproducedduring the reproduction of the digital image data.

In this reproduction method, the reproduction start point and thereproduction end point are designated on the secondary data by inputtingdesignation signals, and for example, if a setting is made such that theinput of the designation signals is available by using one button of thesecondary data preparation means such as a keyboard of a personalcomputer, the operation for designating the reproduction start point andthe reproduction end point on the secondary data can be eased a lot.Therefore, the operations from preparation of the secondary data todistribution can be carried out much more effectively. Further, sincethe digital image data is distributed from the distribution means to theuser terminal without processing, the operation required fordistribution of the digital image content is carried out much moreeffectively, leading to reduction of the cost.

According to the invention, a method of reproducing digital imagecontent comprises the steps of: specifying an image frame by allocatingan image frame-specific code to digital image data so as to correspondto a reproduction start point and a reproduction end point of secondarydata prepared with the use of a markup language; and reproducing thesecondary data synchronously with the digital image data by leading outthe reproduction start point and the reproduction end point of thesecondary data corresponding to the image frame to be reproduced duringthe reproduction of the digital image data. This enables the secondarydata to be reproduced effectively in the sequence suitable for theworking environment.

According to the invention, there is provided a recording mediumrecording a program which makes an information processing devicereproduce secondary data synchronously with digital image data, whereinthe secondary data is prepared with the use of a markup language suchthat a reproduction start point and a reproduction end point correspondto an image frame specific code for specifying an image frame of thedigital image data.

The program reproduces the secondary data synchronously with the digitalimage data. The secondary data is reproduced synchronously with thedigital image data by leading out a reproduction start point and areproduction end point of the secondary data corresponding to an imageframe to be reproduced during the reproduction of the digital imagedata, and the reproduced digital image data and the reproduced secondarydata are superimposed and outputted.

In the above digital image content distribution system using Internet,such a recording medium recording the reproduction program may be arecording device such as a magnetic disk in the server. Thisreproduction program may be stored in a server on the Internet so thatwhen the user requires a distribution of the digital image data and thesecondary data, the reproduction program is downloaded together with thesecondary data. The reproduction program may be distributed to the userin the form of a recording medium such a CD-ROM. In this instance, thereproduction program may be provided as a commercial product widely tousers.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a view explaining distribution and reproduction of digitalimage content according to prior art.

FIG. 2 is a view explaining distribution and reproduction of digitalimage content according to the present invention.

FIG. 3 is a block diagram illustrating the configuration of a digitalimage content distribution system according to the present invention.

FIG. 4 is an explanatory view schematically showing data structures ofdigital image data and secondary data.

FIG. 5 shows an example of preparing the secondary data with the use ofa markup language.

FIG. 6 is an image figure illustrating reproduction of the digital imagedata and the secondary data.

FIG. 7 is a block diagram illustrating the outline of the configurationof a digital image content distribution system using Internet.

FIG. 8 is a flow chart illustrating the sequence of distribution andreproduction in the digital image content distribution system usingInternet.

FIG. 9 is a block diagram illustrating the outline of the configurationof another digital image content distribution system using Internet.

MODES FOR CARRYING OUT THE INVENTION

Preferred embodiments of the present invention will be described below.The following embodiments are for illustrative purpose only, and theyare not limit the scope of the invention. Therefore, it should beunderstood by those skilled in the art that each element or the wholeelements of the invention may be modified or replaced with equivalentsand such an embodiment still falls in the scope of the invention.

With reference to FIG. 2, the outline of the operation according to thepresent invention will be described. FIG. 2 is a view explainingdistribution and reproduction of digital image content according to thepresent invention. In FIG. 2, digital image data 11 and secondary data12 are digitally coded data, and these data 11, 12 are separatelydistributed. The digital image data 11 and the secondary data 12 arereproduced respectively at the receiver side such that the tworeproduction data are superimposed and outputted as digital imagecontent 15.

With reference to FIG. 3, a configuration of a digital image contentdistribution system according to the invention will be described.Herein, FIG. 3 is a block diagram illustrating the configuration of adigital image content distribution system according to the presentinvention. In FIG. 3, a first distribution means 21 distributes thedigital image data 11 to users, and a second distribution means 22distributes the secondary data 12 to users. A communication means or abroadcasting means is used as the first distribution means 21 and thesecond distribution means 22. For example, media such as Internet,digital broadcasting, and CATV may be used. Mailing service may be usedfor distribution.

A first reproduction means 24 reproduces the digital image data 11distributed by the first distribution means 21. The first reproductionmeans 24 achieves the function by a program reproducing the digitalimage data. In the case that the digital image data 11 is distributedthrough a medium such as Internet and the distributed data is reproducedat the receiver side while the receiver side is receiving the data(streaming reproduction), the program comprises a real time reproductionprotocol reproducing the digital image data 11 in real time.

A second reproduction means 25 reproduces the secondary data 12synchronously with the reproduction of the digital image data 11. Thesecond reproduction means 25 achieves the function by a programreproducing the secondary data 12 in such a manner as to lead out areproduction start point and a reproduction end point of the secondarydata 12 corresponding to an image frame to be reproduced during thereproduction of the digital image data 11.

When the digital image data 11 and the secondary data 12 are distributedthrough Internet and the like, the receiver side temporarily stores thedistributed secondary data 12 in the secondary data storing means 23.The data size of the secondary data 12 is considerably small whencompared with the data size of the digital image data 11. Synchronizingthe streaming reproduction of the secondary data 12 and the streamingreproduction of the digital image data 11 at the receiver side causes anextremely low use efficiency of the communication line. For this reason,it is effective that the secondary data storing means 23 is provided atthe receiver side for downloading the secondary data 12 and thesecondary data 12 is led out from the secondary data storing means 23 toreproduce the secondary data 12 synchronously with the streamingreproduction of the digital image data 11.

An output means 26 superimposes the reproduction data of the digitalimage data 11 and the reproduction data of the secondary data 12 andoutputs them. The superimposed data are outputted as the digital imagecontent 15.

Next, with reference to FIG. 4, data structures of the digital imagedata 11 and the secondary data 12 will be described. FIG. 4 is anexplanatory view schematically showing data structures of the digitalimage data 11 and the secondary data 12. In FIG. 4, the digital imagedata 11 consists of a plurality of images such as digitally coded images1-A, 1-B, 1-C, 1-D, etc. These images are distinguishable by a specificcode 31 allocated for each transitional image. Image frame-specificcodes 31 are identifiers for specifying transitional images. In theexample shown in FIG. 4, the image 1-A is outputted when the imageframe-specific code 31 is from 01000001 to 01000025, and the image 1-Bis outputted when the image frame-specific code 31 is from 01000025 to01000050. In the similar manner, the transition of the images 1-C, 1-D,etc., is in-turn carried out corresponding to the value of the imageframe-specific code 31.

For example, if the secondary data 12 is subtitles, the secondary data12 comprises a plurality of subtitles such as digitally coded subtitles2-A, 2-B, 2-C, 2-D, etc. These subtitles are allocated for eachtransitional image such that a reproduction start point 32 and areproduction end point 33 correspond to its image frame-specific code 31of the digital image data 11. The reproduction start point 32 indicatesa reproduction start position of the corresponding subtitles, and thereproduction end point 33 indicates a reproduction end position of thecorresponding subtitles. In the example of FIG. 4, the code datafollowing after “%” indicates the image frame-specific code 31 of thedigital image data 11. Schematically describing, the reproduction of thesubtitles 2-A starts (IN) when the image frame-specific code 31 is01000015, and ends (OUT) when the image frame-specific code 31 is01000020.

With reference to FIG. 5, preparation of the secondary data 12 will bedescribed. FIG. 5 shows an example of preparing the secondary data withthe use of a markup language. In the preparation example of FIG. 5 to bedescribed schematically, the markup language is not limited to aspecific language. In FIG. 5, a title tag <title> indicates the title(DRIVE, DRIVE, DRIVE) of this digital image data 11. Following a tagsuch as a subtitle indicating a profile (abbr. description), a windowtag <window> indicates the width (200), the height (30), and thebackground color (abbr. description) of the subtitle displaying area. Afont tag <font> indicates a character code (shifted JIS code) and acharacter color (white). A tag <center> indicates a displaying position(center) of the subtitles.

A reproduction start tag <point in> and a reproduction end tag <pointout> respectively designate a reproduction start point 32 and areproduction end point 33 for leading out the secondary data 12corresponding to the image frame-specific code 31 contained in thedigital image data 11. Namely, when the image frame-specific code 31 is01000015, the reproduction of the subtitles “I'm glad it's fine today.”is started, and is ended when the image frame-specific code 31 is01000020. A clear tag <clear> clears the subtitles just after completingthe reproduction of the subtitles. In the similar manner, a reproductionstart tag <point in> designates a reproduction start position ofsubtitles and a reproduction end tag <point out> designates areproduction end position of the subtitles.

As a markup language used for preparation of the secondary data 12, forexample, HTML (hypertext markup language), SGML (standard generalizedmarkup language), XML (extensible markup language), and SMIL(synchronized multimedia integration language) may be used.

When the secondary data 12 merely consists of character information,only the layout of the characters has to be set. However, if thesecondary data 12 consists of sound information, such as dubbing or signlanguage, or image information, it is necessary to set the tagindependently to express the structure of the characters. For thisreason, it is preferable to use SMIL which excels in compatibility toreproduce the image data prepared by XML or an XML-based language.

When the secondary data is character information, the size, the color,and the font of the character, etc., can be freely designated. If partof the secondary data 12 is rewritten, only the corresponding part hasto be corrected and there is no need to correct the digital data 11.Further, if a great variety of secondary data 12 such as Japanese,Korean, etc., is prepared, it is possible to provide a user, accordingto his/her taste or purpose, with the secondary data 12 consisting of asuitable translating language.

When the secondary data is sound information such as dubbing ornarration, it is necessary to prepare a sound information file (notshown) separately and to designate a file name of this sound informationfile following the reproduction start tag. Also, when the secondary datais image information such as sign language, it is necessary to preparean image information file (not shown) separately and to designate a filename of this image information file following the reproduction starttag.

The second reproduction means 25 leads out and clears the secondary data12 by in turn leading out the reproduction start tag <point in> and thereproduction end tag <point out> of the secondary data 12 which wasprepared with the markup language. Since the secondary data 12corresponds to the image frame-specific code 31 of the digital imagedata 11, the secondary data 12 is reproduced synchronously with thereproduction of the digital image data 11. In the case that thesecondary data 12 is prepared by sound information or image information,the sound information file or the image information file is led out andreproduced at the reproduction start point 32, and is stopped at thereproduction end point 33.

The output means 26 superimposes and outputs the digital image data 11reproduced by the first reproduction means 21 and the secondary data 12reproduced synchronously with the digital image data 11 by the secondreproduction means 25. The reproduced secondary data 12 such assubtitles is displayed in a certain displaying area on the window. Asdescribed above, since the subtitle displaying position is described bythe markup language, it is possible to designate the subtitles at anyposition, viz., top, bottom, right and left, of the window. Further,when the dubbing and the sign language are simultaneously reproduced asthe secondary data 12, sound and sign language image can be outputtedrespectively from the speakers (not shown) and the window.

As preparation of the secondary data 12, for example, when preparing thesecondary data 12 that is subtitles corresponding to the digital imagedata 11, the translator inputs a reproduction start tag <point in> intothe secondary data 12 at a certain position of the digital image data 11so as to designate a reproduction start point 32 while reproducing andwatching the digital image data 11 at home and the like through apersonal computer. In this instance, the reproduction start point 32corresponding to a certain image frame-specific code 31 of the digitalimage data 11 is allocated upon inputting the reproduction start tag.After inputting the subtitles and the like, and when the translatorinputs a reproduction end tag <point out> at a certain point of thedigital image data 11 so as to designate a reproduction end point 33,the reproduction end point 33 corresponding to the certain imageframe-specific code 31 is allocated. Preferably, reproduction start tags<point in> and reproduction end tags <point out> are inputted by asimple key-operation. This preparation method allows the translator todisplay subtitles at any desired space on the digital image data 11 aswell as to correct the subtitles easily to improve the quality. Further,the translator prepares the secondary data 12 at home without difficultyand in a short time by using a personal computer and the like, and sendthe secondary data 12 instantly from his/her home to the client throughInternet, leading to improved working efficiency. Further, the clientcan directly distribute the secondary data 12 that has been transmittedfrom the translator to user terminals, leading to improved operationefficiency required for distribution of the secondary data 12.

Next, with reference to FIG. 6, reproduction images of the digital imagedata 11 and the secondary data 12 will be described. FIG. 6 is an imagefigure illustrating reproduction of the digital image data 11 and thesecondary data 12. In FIG. 6, the digital image data 11 is reproduced bythe first reproduction means 24 to reproduce images in order of 1-A,1-B, 1-C, and 1-D. In this instance, the reproduction start points 32and the reproduction end points 33 of the secondary data 12 are led outin order by the second reproduction means 25, and subtitles aresynchronized with the digital image data 11 in order of 2-A, 2-B, 2-C,and 2-D to carry out reproduction starts (IN) and reproduction ends(OUT).

When the secondary data 11 is dubbing or narration, the soundinformation 3-A, 3-B, 3-C, and 3-D is reproduced correspondingly to theimages 1-A, 1-B, 1-C, and 1-D of the digital image data 11. Likewise,when the secondary data 11 is sign language, the motion pictureinformation 4-A, 4-B, 4-C, and 4-D are reproduced, respectively.

Accordingly, since the secondary data 12 is prepared by a markuplanguage and the second reproduction means 25 leads out the reproductionstart point 32 and the reproduction end point 33, the secondary data 12is reproduced synchronously with the reproduction of the digital imagedata 11. Further, the secondary data 12 may contain any of characterinformation, sound information, and image information. Therefore, if agreat variety of secondary data 12 consisting of these information isprepared, the user can select the optimum secondary data 12 according tohis/her favor or purpose.

Next, with reference to FIGS. 7 and 8, a description will be given ofone preferred embodiment of a system in which the digital image data 11and the secondary data 12 are distributed through Internet for thepurpose of reproduction. FIG. 7 is a block diagram illustrating theoutline of the configuration of a digital image content distributionsystem 40 using Internet, and FIG. 8 is a flowchart illustrating thesequence of distribution and reproduction of the digital image data 11and the secondary data 12 in the digital image content distributionsystem 40.

In FIG. 7, a user terminal 41 is a terminal for which a user operates. Aserver 42 is a data processing device for distributing the digital imagedata 11 and the secondary data 12 to a user terminal 41. A plurality ofdigital image data 11 and a plurality of secondary data 12 are stored ina digital image data file 47 and a secondary data file 48, respectively,and these data can be distributed to a user terminal 41 through adistribution means 45. Information relating to the distribution of thesedata is stored in a distribution information file 46, and is offered tousers by an information supply means 44 for the purpose of browsing. Theuser terminal 41 and the server 42 are connected through Internet 43.

The information supply means 44 supplies a user with distributioninformation comprising titles of the digital image data 11 and thesecondary data 12 and the profile introduction. The user can access theweb site to browse and inspect the distribution information. Thedistribution information is stored in the distribution information file46 and renewed at a certain period.

The distribution means 45 controls and processes the distribution of thedigital image data 11 and the secondary data 12. When a request fordistribution is received from a user, for example, on the basis of therespective title numbers of the digital image data 11 and the secondarydata 12 contained in the distribution requirement signal, thecorresponding digital image data 11 and the corresponding secondary data12 are respectively distributed to the user terminal 41 from the digitalimage data file 47 and the secondary data file 48, respectively.

It is possible that the secondary data 12 is prepared by a plurality oftranslating languages and advertisements are distributed correspondingto these translating languages. For example, when the secondary data 12of Korean subtitles is selected, advertisements of Korean companies aredistributed in Korean, and when the secondary data 12 of Chinesesubtitles is selected, advertisements of Chinese companies aredistributed in Chinese. Identification numbers may be allocated to thesecondary data 12 to identify translating language categories so thatadvertisements corresponding to the selected translating language areautomatically distributed.

Advertisements may be prepared by using sound information or image inaddition to character information. If advertisements are distributed asseparate secondary data other than the secondary data 12 containingsubtitles, it is possible to reproduce advertisements at any desiredtime such as at the start or end of, or at an intermediate point of thedigital image data 11. Also, the secondary data may be prepared suchthat advertisements and subtitles are made together, and theadvertisements are inserted in an interval of the subtitles.

According to the aforementioned advertisement distribution system,unlike the prior art, advertisements can be readily replaceable anddistributable without preparation of a cue sheet.

The server 42 is made by a computer which can deal with multimedia suchas character, sound, graphics, and image. The hardware of the server 42(not shown) consists of a control/process section totally controllingthe whole server 42, an input/output control section, a memory device,an input device, a display device, an output device, and a communicationsection.

The control/process section consists of CPU and an internal memory, andan operation system and other variety of programs executing controlprocesses with respect to the provision of the distribution informationand the distribution of the digital image data 11 and the secondary data12 are expanded. For example, a WWW server soft which functions as aserver on the Internet 43, a browser soft which facilitates to browseand inspect distribution information on a web site, a content managementprogram which executes administration or change of distributioninformation and the digital image data 11 and the secondary data 12, anda distribution program which executes distribution of the digital imagedata 11 and the secondary data 12 may be included. A program forregistering and distributing advertisements is also included.

With these programs the information supply means 44 and the distributionmeans 45 perform their functions.

The memory device comprises a hard disc, a magnetic disc, or the like,and a distribution information file 46, a digital image data file 47,and a secondary data file 48 are stored in the memory device. Whenadvertisements are distributed, an advertisement file (not shown) isstored in the memory device.

The user terminal 41 is made by a data processing device which can dealwith multimedia such as character, sound, graphics, and image, and forexample, an existing personal computer may be used. As long ascorresponding to the reproduction program, a portable informationterminal or a TV may be applicable. The user terminal 41 comprisestherein a control/process section (CPU and memory), an input/outputcontrol section, a memory device, an input device, a display device, anoutput device, and a communication section. The secondary data 12distributed from the server 42 is temporally stored in the memorydevice. A program for reproducing the digital image data 11 distributedfrom the server 42, a program for reproducing the secondary data 12 thatis temporally stored in the memory section synchronously with thereproduction of the digital image data 11, and a program forsuperimposing and outputting these two reproduction data are expanded inthe control/process section.

The reproduction program of the digital image data 11 can be transferredinto the user terminal 41, irrespective of differences of the codingmethod of the digital image data 11, for example, by downloading areproducing program corresponding to the digital image data 11 from theserver 42 through Internet 43.

The reproduction program of the secondary data 12 does not require acomplicated control processing as the reproduction method of thesecondary data 12 does not depend on the coding method of the digitalimage data 11. The reproduction program may be downloaded from theserver 42 together with the secondary data 12 when the user requests adistribution of the digital image data 11 and the secondary data 12.

The program for superimposing and outputting the reproduction data ofthe digital image data 11 and the reproduction data of the secondarydata 12 may be prepared separately or together with the reproductionprogram of the secondary data 12. When prepared as a separate program,likewise the reproduction program of the secondary data 12, it may bedownloaded from the server 42.

With reference to a flow chart of FIG. 8, the sequence of distributionand reproduction in the digital image content distribution system 40will be described. In FIG. 8, the user accesses from the user terminal41 to a web site which offers use of the digital image contentdistribution system 40, and browses distribution information displayedon the screen (step S101). The displayed distribution informationincludes a profile briefly introducing the digital image data 11 and thesecondary data 12, respectively.

When the user reads the profile, selects desired digital image data 11and secondary data 12, and clicks or depresses the “distribution” button(step S102), the selected secondary data 12 is downloaded and stored inthe memory device of the user terminal 41 (step S103). Subsequently, thedigital image data 11 is distributed and reproduced at the user terminal41 (step S104). When doing so, the secondary data 12 is reproducedsynchronously with the reproduction of the digital image data 11 (stepS105). The digital image data 11 and the secondary data 12 aresuperimposed and outputted to the display device or the output device asthe digital image content 15 (step S106).

The present invention is not limited to the above particularembodiments, and various changes and modifications may be made in theinvention. For example, the distribution means of the digital image data11 and the secondary data 12 is not limited to the Internet 43, andother media such as digital broadcasting and CATV may be used. Further,the digital image data 11 may be stored in a recording medium such as aDVD-ROM and the secondary data 12 may be stored in a recording mediumsuch as a CD-ROM so that they can be distributed by mailing service.Further, a program as a reproduction means of the digital image data 11and the secondary data 12 may be provided through Internet 43 or in theform of a recording media such as a CD-ROM.

When constructing the distribution system using Internet, thedistribution information file 46, the digital image data file 47, thesecondary data file 48 may be integrated and stored in one server.Alternatively, these files may be stored in respective servers. Withreference to FIG. 9, a description will be given of a configurationwhere the digital image data file 47 and the secondary data file 48 arestored in separate servers. FIG. 9 is a block diagram illustrating theoutline of the configuration of a digital image content distributionsystem 40 a using Internet. Parts or elements similar to those of thedigital image content distribution system 40 will be denoted by the samereference numerals and the description thereof will be omitted.

In FIG. 9, a plurality of digital image data 11 is stored in the digitalimage data file 47 in the first server 42 a and a plurality of secondarydata 12 is stored in the secondary data file 48 in the second server 42b, and the respective data 11, 12 are distributed to the user terminal41 through the distribution means 45 a of the first server 42 a and thedistribution means 45 b of the second server 42 b. Information withrespect to the distribution of each data 11, 12 is stored in therespective distribution information files 46 a, 46 b, and by theinformation supply means 44 a, 44 b the user can browse the informationthrough Internet 43. For example, at the user terminal 41, it ispossible to superimpose and output the digital image data such as amovie distributed from the first server 42 a to each country and thesecondary data 12 such as subtitles of each translating languagedistributed from the second server 42 b established at each country.According to this, the distribution information, the digital image data11, and the secondary data 12 can be independently edited, registered,and renewed, and advertisements corresponding to the translatinglanguage category are distributed together with the secondary data 12,thereby enhancing the commercial value of the secondary data 12 alone.Further, since the digital image data 11 and the secondary data 12 areseparately administered and distributed, there is no need to store thedigital image data 11 and the secondary data 12 in one server foradministration. Therefore, the server 42 b for distributing thesecondary data 12 with relatively small volume of data does not requirehigh data processing capacity, thereby leading to cost reduction forfacilities.

INDUSTRIAL APPLICABILITY

As mentioned above, the following advantages are obtained according tothe present invention.

In this digital image content distribution system, since the secondarydata and the digital image data are separately prepared andsynchronously distributed in such a manner that the secondary data isreproduced synchronously with the digital image data, there is no needto reedit the digital image data. This enables to reduce the edit cost.Further, flickering of the subtitles in the prior art system iseliminated.

Further, since the operation of the translator, etc., for designatingreproduction start points and reproduction end points on the secondarydata is eased a lot, operations required from the preparation of thesecondary data to the distribution thereof will be made much moreeffectively. Especially, edit and correction of the secondary data willbe made easily, which leads to improved quality of the secondary data.Multimedia such as character, sound, and image is available for thesecondary data, and dubbing or sign language can be handled as dataother than the digital image data. Therefore, by separatelyadministrating and distributing the digital image data and the secondarydata by different servers, it is possible to enhance the commercialvalue of the secondary data alone. Further, the server only fordistributing the secondary data may be a server with low data processingcapacity, thereby leading to cost reduction for facilities. These canreduce a large amount of preparation cost of the secondary data, whichdiscourages companies to prepare the secondary data.

Further, the producer of the secondary data can prepare the secondarydata at home without difficulty and in a short time by using a personalcomputer and the like, and send the secondary data instantly fromhis/her home to the client. This allows the client to ask thepreparation of the secondary data for a producer staying at any place.Especially, when the secondary data is subtitles, the client can easilyask the translation for translators around the world, which enhances thequality of subtitles without increasing the cost.

Further, the user can select and reasonably enjoy desired digital imagedata and secondary data at any time through Internet. The secondary datamay be prepared by a great variety of translating language so that theuser can select a desired menu.

Further, since it is possible to distribute appropriate advertisementscorresponding to the translating language category of the secondarydata, the user can watch the advertisement without awareness. Ifadvertisements are distributed as the secondary data, the advertisementscan be readily replaceable and distributable without preparation of acue sheet.

Further, in this reproduction system, a dedicated hardware is notrequired for reproducing the digital image data and the secondary data.If a program for reproduction is installed in the existing personalcomputer, the digital image data and the secondary data can be readilyreproduced.

Furthermore, according to the recording medium recording such areproduction program, it is possible to distribute and sell the softwareas a commercial product independently of the hardware of the informationprocessing device. If such a reproduction program is executed by theinformation processing device such as a personal computer, reproductionof the digital image content is achieved.

1. A digital image content distribution system comprising: a serverwhich distributes digital image data and secondary data whichcorresponds to the digital image data, the server comprising: an imagedata file which stores the digital image data; a secondary data filewhich stores the secondary data; a distribution information file whichstores distribution information relating to the digital image data andthe secondary data; a distribution means for distributing the digitalimage data and the secondary data in accordance with a requirement fromthe user terminal; and an information supply means for supplying theuser terminal with the distribution information; and a user terminalwhich reproduces the distributed digital image data and the distributedsecondary data, the server and the user terminal being connected to eachother through Internet, wherein the secondary data is prepared with theuse of a markup language such that a reproduction start point and areproduction end point correspond to an image frame-specific code forspecifying an image frame of the digital image data, and wherein thedigital image data and the secondary data are prepared and distributedseparately, the secondary data is reproduced synchronously with thedigital image data such that the reproduction start point and thereproduction end point of the secondary data corresponding to the imageframe to be reproduced are led out during the reproduction of thedigital image data.
 2. A digital image content distribution systemcomprising: a first server which distributes digital image data, thefirst server comprising: an image data file which stores the digitalimage data; an image data distribution information file which storesdistribution information relating to the digital image data; adistribution means for distributing the digital image data in accordancewith a requirement from the user terminal; and an information supplymeans for supplying the user terminal with the distribution informationrelating to the digital image data, and; a second server whichdistributes secondary data corresponding to the digital image data, thesecond server comprising: a secondary data file which stores thesecondary data; a secondary data distribution information file whichstores distribution information relating to the secondary data; asecondary distribution means for distributing the secondary data inaccordance with a requirement from the user terminal; and a secondaryinformation supply means for supplying the user terminal with thedistribution information relating to the secondary data; and a userterminal which reproduces the distributed digital image data from thefirst server and the distributed secondary data from the second server,the user terminal connected to the first server and the second serverthrough Internet, wherein the secondary data is prepared with the use ofa markup language such that a reproduction start point and areproduction end point correspond to an image frame-specific code forspecifying an image frame of the digital image data, and wherein thedigital image data and the secondary data are prepared and distributedseparately, the secondary data is reproduced synchronously with thedigital image data in a manner such that the reproduction start pointand the reproduction end point of the secondary data corresponding tothe image frame to be reproduced are led out during the reproduction ofthe digital image data.
 3. A digital image content distribution systemaccording to claim 1 or claim 2, wherein the secondary data is preparedby a plurality of translating languages, and advertisementscorresponding to a distributed translating language are automaticallydistributed.